Evaluating Unsupervised Language Model Adaptation Methods for Speaking Assessment
نویسندگان
چکیده
In automated speech assessment, adaptation of language models (LMs) to test questions is important to achieve high recognition accuracy However, for large-scale language tests, the ordinary supervised training, which uses an expensive and time-consuming manual transcription process, is hard to utilize for LM adaptation. In this paper, several LM adaptation methods that require either no manual transcription process or just a small amount of transcriptions have been evaluated. Our experiments suggest that these LM adaptation methods can allow us to obtain considerable recognition accuracy gain with no or low human transcription cost.
منابع مشابه
Translation and cross-cultural adaptation of a new Persian version of Language Assessment, Remediation, and Screening Procedure: A Preliminary Norm-Referenced Morphosyntactic Sketch for Persian-Speaking Children Aged 2-5 years
Introduction: In 1998, the Persian form of Language Assessment, Remediation, & Screening Procedure (P-LARSP) was introduced. However, this adapted version remained on library shelves and was not used by Iranian speech and language pathologists (SLPs). The present study aimed to explore the barriers to using P-LARSP, resolve the possible issues, and provide a preliminary grammatical sketch from ...
متن کاملApplying Unsupervised Learning To Support Vector Space Model Based Speaking Assessment
Vector Space Models (VSM) have been widely used in the language assessment field to provide measurements of students’ vocabulary choices and content relevancy. However, training reference vectors (RV) in a VSM requires a time-consuming and costly human scoring process. To address this limitation, we applied unsupervised learning methods to reduce or even eliminate the human scoring step require...
متن کاملConstruction of Evaluative Meanings by Kurdish-Speaking Learners of English: A Comparison of High- and Low-Graded Argumentative Essays
Academic writing ability is an important goal that learners of English as a Second Language (ESL) or English as a Foreign Language (EFL) try to attain. While ESL students’ academic writings have been widely explored, owing to few studies investigating appraisal resources in EFL students’ argumentative writing, the gap still exists about EFL students’ academic writing. This study aimed to see ho...
متن کاملPresentation of an efficient automatic short answer grading model based on combination of pseudo relevance feedback and semantic relatedness measures
Automatic short answer grading (ASAG) is the automated process of assessing answers based on natural language using computation methods and machine learning algorithms. Development of large-scale smart education systems on one hand and the importance of assessment as a key factor in the learning process and its confronted challenges, on the other hand, have significantly increased the need for ...
متن کاملPresentation of an efficient automatic short answer grading model based on combination of pseudo relevance feedback and semantic relatedness measures
Automatic short answer grading (ASAG) is the automated process of assessing answers based on natural language using computation methods and machine learning algorithms. Development of large-scale smart education systems on one hand and the importance of assessment as a key factor in the learning process and its confronted challenges, on the other hand, have significantly increased the need for ...
متن کامل